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Abstract 

Given a parametric nonlinear optimization problem in finite di- 
mensions, we consider the corresponding stationary point set. We ad- 
dress the question of its topological complexity as a stratified space. 
More precisely we ask ourselves whether there exists some sort of nor- 
mal form, e.g. a small subclass of problems already carrying all the 
complexity a general stationary point set may have. Our main result 
answers this question as follows. 

For almost all nonlinear problems the local structure of its sta- 
tionary point set can already be found in a quadratic problem with 
strictly convex objective function. 

As a consequence we see, as far as no equality constraints are 
involved, that the closure of the stationary point set constitutes a 
manifold with boundary. The boundary is exactly the violation set of 
the Mangasarian Fromovitz constraint qualification. 

A side result states that stationary point sets and violation sets of 
Mangasarian Fromovitz constraint qualification carry the same set of 
possible local structures as stratified spaces. 
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1 Introduction 



We consider parametric families of constraint sets M(y) and of optimization 
problems V(y). Here, y G W is a parameter and the objects of our study are 
defined as follows: 

M(y) = {x G R n | gi(x,y) < 0, i = 1 . . .m<, hj(x,y) = 0, j = 1. . .mj}) 
V(y) minimize f(x,y) s.t. x & M(y), (2) 

where the appearing objective function / and the constraint functions gi, hj 
are supposed to be smooth, i.e. from C°°(M n+p ). Throughout the paper, for 
sake of a simpler exposition, all mappings, manifolds, etc., are supposed to be 
smooth unless otherwise stated. For various reasons it is convenient to refer 
to the objective function / also with the symbol g m * , where m< := m< + 1, 
i.e. we use the identity g m * = f. 

We are mainly interested in the local topological structure of the station- 
ary point set, defined by setting 

SP := SP(f,g, h) := {(x, y) \ x is a stationary point for V(y)}. (3) 

Knowledge of this structure may be helpful in various instances, especially 
if SP serves as a constraint set of a so-called upper level problem, such as 
in bilevel optimization or in mathematical programming with equilibrium 
constraints, c.f. [8]. 

Our main result is some kind of universality theorem, roughly stating that 
any topological structure of a stationary point set appearing in general non- 
linear optimization may already be found in convex quadratic optimization. 
This also involves, that unstable situations may be represented by stable 
situations upto some sort of topological equivalence. 

In order to formulate this result more precisely, we need some concepts. 
First, we introduce a combinatorial code for feasible points x G M(y). One 
(but not the main) reason for using this concept is the precise definition 
of stationary points and the Mangasarian Fromovitz constraint qualification 
(MFCQ). We start with the indexed Lagrange function, defined for I C 
{1 . . . m<}, J C {1 . . . m=}, and operating on the variables (x,y) G M n+P , 
and Ui, Xj G R by setting 

Li,j := ^2nigi(x,y) + ^2\jhj(x,y). (4) 

The combinatorial code of a feasible point x G M(y) consists of two parts. 
The first part is the index set Jq = Io(x,y) of active inequality constraints, 
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defined be setting J := {i \ gt(x, y) = 0}. Moreover let Iq := J U{m<}. The 
second part of the code is the set X = X(x, y), containing all pairs of index 
sets (/, J), / C Iq, J C {1 . . . m=} whose disjoint union is minimal (w.r.t. 
inclusion) within the set all such pairs with the properties that their disjoint 
union is nonempty and that there exist multipliers \x\ > 0, i G I, X 3 ■ ^ 0, 
j G J, such that D x L Iy] = 0. Letting 1 SP := {{I, J) G I | m< G 1} and 
x mf := x\X SP it is clear that 

x G M(y) is a stationary point if and only if X SP is nonempty, (5) 
MFCQ is violated at x G M(y) if and only if X MF is nonempty. (6) 

(The latter characterizations may also be taken as definitions for stationary 
points and MFCQ.) 

Second, we need a symbol for the problem size; here we simply use (n, m) 
or (n, m,p) (depending on the context), n standing for the dimension of the 
state variable x, m = (m<,m = ) for the number of (inequality and equality) 
constraints, and p for the dimension of the parameter vector y. For ease of 
notation put m* := (m<,m = ). 

Third, we need a topology on the set of problem data (/, g, h) of a given 
problem size (n,m,p) in order to specify the (large) class of problems our 
results refer to. To this end we use the Whitney C topology on C°°(M a , IR b ), 
where a base neig hborhood of F G C°°(M a ,M b ) is defined by means of a 
strictly positive continuous function ip : M. a — > (0, oo) by setting 

U V {F) := {G | \d a (G - F)(x)\ < <p(x) \/x G R a , \a\ < I}, 

where a denotes the multi- index of a partial derivative and \a\ its order. Note 
the Whitney C k topology gets stronger (bigger), as k increases. The Whitney 
C°° topology is then defined as the union of all C k topologies, fceN. 

Fourth, we describe the small class of quadratic problems that turns out to 
already represent all the complexity a stationary point set may have (within 
the problem class our theorem is referring to). We call a problem V(f,g, h) 
of type ([2]) a special quadratic problem SQP if 

f(x, y) = \\x - c|||, gi(x, y) = ai(y) T x + ai(y), hj(x, y) = bj(y) T x + (3j(y), 

for given fixed vector c G IR n , variable vectors ai(y), bj(y) G M n and variable 
scalars aa(y), (3j(y). We say that SQP is smooth if the data aj, bj, j3j are. 
Sometimes it is convenient to identify SQP with its problem data (f,g,h), 
in particular SP(SQP) := SP(f,g, h) is just the stationary point set of the 
special quadratic problem SQP. 

Finally, we need a concept to compare the local topological structure of 
sets. In order to do so we use stratifications. A stratification of a given set 
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A C M n is a locally finite partition A C 2 A of A into smooth submanifolds 
of R n . The latter submanifolds are also called strata. In the latter case the 
pair (A, A) is called a stratified set. 

Two stratified sets (A, .A) and (B,B) are called isomorphic, abbreviated 
by (A,A)~(B,B), if there exists a homeomorphism (in general not differ- 
entiable) if : A — > B such that for any X G A there is a F G S such that 
ip : X — > Y is a diffeomorphism. Such a homeomorphism is also referred to 
as an isomorphism of the compared stratified sets. The stratified sets (A, A) 
and (B, B) are called locally isomorphic at a G A and b £ B, abbreviated 
by (A, .4) ~ (-S, B)b, if there exist open neighborhoods U a of a and Ub of 6 
and a local isomorphism ip : (A, A) fl U a — > (B, B) fl Ub with <p(a) = b, where 
AnU a := {XnU a | X G ^4}, etc. We do not always specify the stratifications 
to be used and we then say that A a ~ Bb are locally isomorphic if there exist 
stratifications A and B such that (A, A) a r ^ (B, B)b- 

Theorem 1 (Universality of Convex Quadratic Optimization) For any 

problem size (n,m,p) there exists aC°° -dense andC 2 -open classC C C°°(IR n+p , ]jj 1 + m <+ m =) 

such that for any choice of problem data (/, g, h) G C and any (x, y) G 

SP(f, g, h) there exists a special quadratic problem SQP of the same problem 

size and a parameter y' G W such that SP(f, g, h)^,y)^ SP(SQP)(o,g')- The 

local isomorphism if can be chosen such that it preserves the combinatorial 

code, i.e. (Io,I) o ip = (I ,X). 

We define the violation set of MFCQ by setting 

MF := MF(g, h) := {(x, y) \ MFCQ is violated at x G M(y)}. (7) 

In case that Mangasarian Fromovitz constraint qualification (MFCQ) holds 
at the stationary point for SQP(y'), the constraint set of SQP(y) may not 
become empty, provided that y is from a sufficiently small neighborhood of y 1 , 
hence the continuous mapping y i— > (argmin SQP(y), y) locally parametrizes 
SP(SQP). This proves that (SP \ MF)(SQP) is a topological manifold of 
dimension p. Since the isomorphism ip stated in our theorem is a homeomor- 
phism preserving the combinatorial code and since MFCQ is characterized 
by means of this code (recall Theorem [T] implies that (SP\MF)(f, g, h) 
is a topological manifold of dimension p as well, provided that the problem 
data are from the class C. This is the main result of [1], where a direct, but 
much more complex proof was presented. 

The following even stronger topological property of stationary point sets 
also follows as a consequence of Theorem (TJ but by far not as immediately. 
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Theorem 2 (Manifold with boundary property) For any problem size 
(n, m,p) with m= = there exists a C x '-dense and C 2 -open set C of problem 
data such that for any choice of problem data (f,g) G C the closure SP of 
the stationary point set constitutes a p- dimensional topological manifold with 
boundary. The boundary is precisely MF(g). 

As side results we will see that stationary point sets and MFCQ violation 
sets are in certain sense of the same topological complexity. In order to 
explain this more exactly, we associate the symbols SP and MF with the 
corresponding problem size. 

Provided that the problem data are not ill posed, we will in fact show that 
any SP(n, m,p) is locally isomorphic to some MF(n, m*,p+ l){ m * } and any 
MF(n, m,p) with m= = is locally isomorphic to some SP(n + 1, m,p — 1), 
where MF I := {(x, y) G MF \ I C I (x, y)} for / C {1 . . . m*<}. 

Note that this shows that, regarding the topological complexity of SP(n, m,p), 
it does not matter where a specific function enters the definition of SP: as 
objective function or as an inequality constraint function. This intimates 
certain symmetries between objective and inequality constraint functions, as 
known in the case of generalized semi- infinite optimization, cf. [5]. These 
assertions are based on what we call "regular transformations", which are 
dealt with in Section [6j 

2 Preliminaries (from differential topology) 

In this section we consider certain tools from differential topology that are 
needed to prove our results. We introduce Whitney regular stratifications 
and fibres thereof, which are just inverse images of single points w.r.t. local 
projection mappings onto the strata. It turns out that the topological struc- 
ture of a fiber does not depend on the particular projection mapping that is 
used, see Corollary [TJ and that the local structure of the entire set is just a 
cylinder over one fiber, i.e. a Cartesian product of the fiber with a trivial 
space, see Theorem |U Moreover, the structure of the fibres is pulled back by 
transversal mappings, see Lemma [TO! 

Our main tool is Thorn's Isotopy Lemma for Whitney regularly stratified 
sets, cf. [2]. We say that a stratified set (A, A) C W 1 (or the stratification A 
of A) is Whitney regular if for any pair X, Y G A of different strata and any 
point x G X fl Y the following holds: for any pair of sequences Xk,yk — > x, 
Xk G X, y k G Y, with the convergence properties span(y fc — — > L and 
T yk Y — > T, we have L C T. Here, T y Y stands for the tangent space of the 
submanifold Fcl™, regarded as a linear subspace of M. n , and we say that a 
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sequence of m-dimensional subspaces Vf. C W 1 converges to an m-dimensional 
subspace V C W 1 if the Hausdorff distance of their intersection with the unit 
ball in IR n tends to zero. (This is just the convergence in the Grassmannian 
manifold of m-dimensional subspaces of M n .) For a stratified set (A, A) and 
a manifold P we define the Cartesian product P x (A, A) := (P x A, P x A), 
where P x A := {P x X \ X e A}. Note that P x {A, A) is again Whitney 
regular provided that A is. 

For splitting the local topological structure of a Whitney regularly strat- 
ified set (A, A) C lR n at x G X, X G A, into a smooth part (just X) and a 
more complex part (for instance A D T^X -1 ) we need tubular neighborhoods. 
Given a submanifold X C R n , we call the triple (T,7r,p) a tube (at X) if 
T D I is an open neighborhood, n : T — > X is a projection mapping (i.e. 
7r|x = idx) an d p : T — > R is a quadratic distance function of C k Riemannian 
metric (c.f. [2]). For a given tube (T, it, p) at X and i € J let A fl 7r~ 1 (x) 
denote the fiber oi A generated by the given tube at x. In case that X is a stra- 
tum of a Whitney regular stratification A of A, the stratification A induces 
a natural Whitney regular stratification ^4.ri7r~ 1 (x) := {Y nir~ 1 (x) \ Y G A} 
of the fiber Ar\n~ 1 (x) (at least in the neighborhood of x, where tt\y remains 
a submersion for any Y G A, Y ^ X), c.f. [6]. 

Definition 3 (cf. [2]) Lei (A, .A) C 17 C M n be a stratified subset of the 
open set U and f : U — > P a mapping to a manifold P. We say that 
(A, A) is (topologically) trivial over P (w.r.t. f) if there exists a stratified 
set (B,B) and a stratified isomorphism ip : P x (B,B) — > (A, A) such that 
f o ip = lip, where Up : P x B — > P denotes the canonical projection 
(p,b) i — y p. The mapping <p is referred to as a trivialization. (Note that 
{B,B) ~ (A, A) n Z" 1 ^) for any choice of p G P.) 

For an open set U dW 1 we define the restriction of (A, A) to U by setting 
(A, A) D U := (AnU,AnU), where AC) U := {X DU \ X E A}. We say 
that (A, A) is locally trivial over P (w.r.t. f) at a G A if the point a has a 
neighborhood U C lR n and f(a) a neighborhood V C P such that (A, A) C\U is 
trivial over V. Here, cp : V x B — >• (A, A) DU is called a local trivialization. 

Theorem 4 (Thorn's Isotopy Lemma, cf. [2]) Let (A, A) be a locally closed 
Whitney regularly stratified subset of an open set U C M. n , and f : U — > P 
such that for any X C A the restriction f\x is a submersion and f\xnA ^ s 
a proper map, i.e. the inverse image of any compact set in P is a compact 
subset of X H A. Then, (A, A) is locally trivial over P (w.r.t. f). 

The following theorem connects locally defined tubes at the same stratum 
to one single tube, thus enabling Thorn's Isotopy Lemma to compare their 
fibers (see Corollary [7] below.) 
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Theorem 5 (cf.[2|) Let X C U be a submanifold of an open subset U C M. n 
and f : U —> P a mapping to a manifold. Suppose that f\x is a submersion. 
Now, let Xq, X\ be relatively open subsets of X such that X\ C Xq and ttq 
is the projection mapping of a tube at Xq, compatible with f , i.e. f o tt = f . 
Then, there exists a tube at X , also compatible with f , such that for its 
projection mapping it we have Tr^-ip^) = tto- 

Corollary 6 (cf. [3]) Let (A, A) be a locally closed Whitney regularly strat- 
ified subset ofR n and (T, it, p) a tube at X G A. Then, (A, A) is locally trivial 
over X w.r.t. it. (Note that it does not need to be proper.) 

Proof. (This easy proof has been taken (for the sake of more self-containment) 
from j3].) Since (it, p)\y is a submersion in a neighborhood of X, there exists 
for given x G X a relatively open neighborhood X C X of x and e > such 
that 

B := {X } U{Yf] p-^O, e),Y f] p~ 1 (e) \Y e A,Y ^ X}n tT^Xq) 

is a Whitney regular stratification of B := A fl 7r _1 (X ) R p _1 [0,£:] and the 
restriction of it to any stratum of B is a submersion. Restricted to B, it is 
even a proper map, thus Theorem H] applies. □ 

Corollary 7 Let (A, A) be a locally closed Whitney regularly stratified subset 
of an open set [/cK™. Let X G A be a connected stratum and let (Tj, m, Pi), 
i = 1,2, be tubes at relatively open subsets X, C X. Let Xi G Xi and 
(Bi,Bi) := (A, A) ri7r i ~ 1 (xj) be the corresponding fibers. 

Then we have (Bi, B\) Xl ~ (B 2 , B'l)^, where the local isomorphism <p can 
be chosen compatible with A, i.e. such that (p : yfl7rf 1 (xi) — > YC]tt2 1 (x2) for 
any Y G A. This means in particular, that for a connected stratum X £ A 
the fiber (A, A)x,x '■= (A, A) fl tt~ 1 (x) generated by a tube (T, it, p) at X with 
x G X is defined up to local stratified isomorphism without specifying the tube 
that is used. 

Remark 8 For the definition of the equivalence class (A,A)x,x H is not 
required that X is connected, since U 3 x can be chosen such that X fl U is 
connected. 

Proof of Corollary^ Since n^y is a submersion in a neighborhood of Xi, 
(Bi, Bi) is a Whitney regularly stratified set in a neighborhood of Xi, cf. [6]. 
If X = {x} is a singleton, there exists only one single projection mapping 
7r : U — > X, i.e. there is nothing to prove. Otherwise, we treat two cases. 
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Case 1: x± ^ x 2 - Without loss of generality we may assume that Ti flT 2 = 0. 
Applying Theorem [5] to Xq := X\ U X2, tiq := tx% on tt~ (Xi) and a smaller 
relatively open subset of X containing both x\ and X2, we see that iii and 
7r 2 are restrictions of a globally defined projection mapping 7r of a tube at X 
to neighborhoods of xi, X2, respectively, 

Since X is connected, there is a continuous curve 7 : [1,2] — > X with 
7(1) = x\ and 7(2) = x 2 - According to Corollary [6] any j(t), t G [1,2], 
has a relatively open neighborhood U t in X such that on U t all the fibers 
(A, A) D 7r _1 (a;) with a base point x E U t are locally isomorphic and the 
isomorphism can always be chosen compatible with A. 

Since we only need a finite number of such Ut to cover 7[1,2], we have 
(A, A) fl 7r _1 (xi) ~ (A, A) H vr _1 (x2) and the local isomorphism may also be 
chosen compatible with A. 

Case 2: Xi = x 2 . Applying Corollary [HI we ensure the existence of x 3 G 
X, x 3 ^ x\ = x 2 , such that (A, A) fl (x±) ~ (A, A) fl 7r£~ (x 3 ). Now we 
can apply the assertion proved in Case 1 to x 2 7^ £3 delivering (A, .A) fl 
7rf (X3) ~ (A, A) fl 7T 2 _1 (x2). Since all local isomorphisms can be chosen com- 
patible with A, the desired isomorphism is established. □ 

Definition 9 (cf. [6]) Let be given a stratified set (A, A) C R m and f : 

M. n — > IR m . We say that f meets a stratum X G A transversally (symbol 
f(fiX) if for any y G f~ l {X) we have Df(y)[R n ] +Tf( y )X = R m and we say 
that f meet (A, A) transversally (symbol f(f) (A, A) ) if fW\ X for all X G A. 

Lemma 10 Let be given a locally closed Whitney regularly stratified set 
(A, A) C R m and f : R n -»■ R rn such that /rfi (A, A) . For X C R rn let be 
X' := f~ l (X), and define A' := {X' | X G A}. Then, f~ l (A : A) := (A', A') 
is a Whitney regularly stratified set. Moreover, for any X G A, x G X and 
x' G X' with f(x') = x, the fibers (A', A')x',x' an d (A,A)x,x ar ^ isomorphic 
and the corresponding isomorphism can be chosen compatible with /, i.e. it 
sends any stratum Y' G A' to the corresponding stratum Y G A. 

Proof. The mapping (p := (id, f) : R n — > R n x R m is an embedding, i.e. 
tp : R n ->■ M := ip(R n ) is a diffeomorphism. Defining Xf :R n xR m R m by 
setting Xf(y, z) := z — f(y), we obviously have M = ^/ _1 (0). The transver- 
sality of / to Y G A is equivalent with the property that the restriction of Xf 
to the stratum R n x Y of lR n x (A, A) is a submersion, cf. [6]. This implies 
that <p(A',A) = [R n x (A, A)] D X/ _1 (0) is a Whitney regularly stratified 
set, hence (A', A') is, see [5]. Note that A' is locally closed. 

The desired isomorphism between the compared fibers is established by 
means of a sequence of isomorphisms. We start with a projection mapping 
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7Ti : R n x R m ->l"xl that is compatible with Xf. According to Theorem 
such a projection mapping exists. Since ~K\ is compatible with Xf and it 
holds M = X/ _1 (0), the restriction of m to M is a projection mapping onto 
X n M and the fiber [R n x (A, A)] C ^(x^x) completely lies inside M. 

Defining t\2 '■ R n — > X' by setting 7r2 := (p^ 1 o 7Ti o y?, it is clear that the 
diffeomorphism : R n — > M transfers the representative (A', A') fl tt 2 ' 1 (x') 
of (A',A') x >,x> onto [R n x (A, A)] n ^ l (x',x). Note that any Y' G A' is 
transferred to the corresponding R" x F. 

Given an arbitrary projection mapping 713 : R m — > X, we know that 
(A, A) H 7r^" 1 (a;) represents (A, A)x,x- We define a projection mapping 7r 4 : 
R™ x R m — y M. n x X by setting 7r 4 (y,2:) := (y,7r 3 (z)). Then, we obviously 
have 

[R n x (A, A)] n vrjV^) = {x'} x [(A, A) n tt^x)], 

i.e. the smooth embedding z 1— > {x',z) is an isomorphism between (A, A) fl 
7r^ 1 (a;), representing (A,A)x,x, an d P n x (A, A)] H ttJ^x', x). Note that 
y G A is mapped to R n x y. 

Finally, [R n x (A, A^Ctt^x', x) and [R n x (A, ^4)] fl^ x) are isomor- 
phic according to Corollary [7] and Remark [HJ where the isomorphism maps 
R n x y to R n x y for any Y G A. 

Altogether, we have a sequence of isomorphisms 

(A',A') X ', X > -> [M n x (A^)]n7r 1 - 1 (x , ,x), 
[R n x (A,A)] nvrrV^) [R n x (A, A)] fl 7r 4 ~ 1 (a; / , x), 
[R n x (A, A)] n ttJV, x) -> (A, A)x,x, 

transferring Y' -> R n x y -> R™ x y -»■ Y for any y G A. □ 

Corollary 11 For any locally closed Whitney regularly stratified set (A, A) C 
R n , any stratum X G A, any frase point x G X and any y G R m it hold 

Proof. Apply Lemma [TOl to / (x, y). □ 

3 Proof of the Universality Theorem 

We represent = SP(f,g,h) in terms of jet extensions. To this end we 
collect all function values and partial derivatives of the problem data (/, g, h) 
that are needed to define the stationary point set in one single mapping, called 
a (reduced) jet extension jSP := jSP(f,g, h) defined by setting 

jSP := ((D x gi, g u D x hj, ^)(ij)=(i,i)-m, D x f) , (8) 
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meaning that i and j run through all numbers from 1 to m< and m=, re- 
spectively. The jet extension is called "reduced" if not all partial derivatives 
of all functions enter. Hence jSP maps to the jet space JSP := 

JSP(n,m) := Mnm<+m<+nm = +m = +n _ Variables in the jet space are denoted 
as follows in order to fit easily with the mapping jSP: for ai,bj G M. n , 
a G R m ^, /3 G R m = let 

aSP :=:= ( (a h on, b h ^)n d )=( ltl)mm , a m * ) G JSP. (9) 



We define the combinatorial code (Iq,I) on the elements of JSP as follows. 
Let I = I (a SP) := {i \ a { = 0}, J * := I U {m^} and 



C := C(a SP) := {{fx, A) G [0, oo) m < x 



a < 0, /ii = Vz' ^ J * 



(10) 

The second part X = X[a SP) of the code is defined to be the set of pairs 
(/, J) with / C Iq, J C {1 . . .m = }, whose disjoint union IUJ is minimal 
(w.r.t. inclusion) within the set of all pairs such that I(jJ ^ and there 
exists (/!, A) G C with /ij > Vz G /, Aj ^ Vj G J. We partition X into 
X SP and X MF , where X SP contains all elements (/, J) of X with m< G /. 
By construction the combinatorial code is preserved by jSP(f,g,h) for all 
problem data (f,g,h) of size (n, m), i.e. we have (Io,T) o jSP(f, g,h) = 
(Iq,X). In such a way we define subsets of JSP being characteristic for 
stationary points and violation points of MFCQ, respectively: 

XSP := {a SP G JSP | l SP (a SP) ^ 0}, (11) 
XMF := {aSPe JSP | l MF {aSP) + 0}. (12) 

Since jS'P respects the combinatorial code, we have SP = jSP~ 1 (XSP) and 
MF = jSP~ l {XMF). Since the objective function / does not enter the 
definition of MF, we also (preferably in Section [6]) use jMF, defined as jSP 
with deleted entry D x f, and the corresponding XMF in the target space 
JMF of jMF as XSP with deleted entry a^. 

It holds aSP G (XSP U XMF) if and only there exists (/i, A) G C(<7 SP) 
with E /ij + E I -\? I = 1- Thus a compactness argument can be used to show 
that XSP U XMF is closed. Analogously it follows that XMF is closed. 
Moreover we show that XMF C XSP, hence XSP U XMF = XSP. Indeed, 
any cr SP G XMF can be approximated by points from XSP. If a SP does 
not belongs to XSP itself, we take some (/, J) G X(cr SP) and proceed as 
follows. First we note that m< does not belong to 1. By the minimality of 
(/, J) it follows that the convex cone generated by a^, i G /, and 6j, j G J, 
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is a linear subspace of M n , which does not contain a m ^. By adding a small 
positive multiple of a m * to all the vectors a i; i E I, bj, j E J, we obtain a 
point from XSP arbitrarily close to a SP. 

We partition XSP according to the combinatorial code, i.e. two points 
belong to the same partition element if and only if their combinatorial codes 
coincide. The latter partition is semi-algebraic, i.e. its elements are semi- 
algebraic sets. Here, a semi- algebraic subset of M n is a finite union of ele- 
mentary semi-algebraic sets, where an elementary semi- algebraic subset of 
M n is the finite intersection of sets of the form / _1 (0) and g~ x (— oo, 0), where 
f,g are polynomials (with real coefficients). It is immediately clear that a 
finite union of semi-algebraic sets is semi-algebraic. A finite semi-algebraic 
partition (of a semi-algebraic set) admits a finite refinement that is a Whit- 
ney regular stratification, c.f. [TJ. Applying this to our partition according 
to the combinatorial code we see that there exists a finite Whitney regular 
stratification A of XSP such that the combinatorial code is constant on each 
stratum. Since XSP C XSP is defined by properties of the combinatorial 
code and the combinatorial code is constant on any stratum of A, there exists 
AC A such that (j A = XSP. 

Let C := {(f,g,h) | jSP(f, g, h)(f\ (XSP, A)}. According to the Jet 
Transversality Theorem, c.f. [6], the set C is C°°-dense and C 2 -open. For 
any choice of problem data (/, g, h) E C we can argue as follows. Let 
SP := SP(f, g, h), etc., and let (x, y) E SP and define z := jSP(x, y). Now 
let Z E A denote the stratum containing z. Let (Fx, Fx) := (XSP , A)z,z be 
the fiber of XSP at Z with base point z and (Fx, Fx) = (XSP, A)z,z be the 
part of that fiber belonging to XSP. Letting (F 2 ,F 2 ) ■= (SP , j S P~ x (A)) be 
the fiber of SP at the stratum Z' := jSP~ 1 (Z) with base point (x, y) and 
(F 2 ,J Z 2) = (SP,jSP~ 1 (A))z , ,(x,y) be the part of that fiber belonging to SP, 
Lemma [TU1 implies that (F 2 , J r 2){x,y) ~ (Fi, ^i)z, where the isomorphy tp can 
be chosen compatible with A, which implies 

(F 2 ,T 2 ) ix ,y ) ^(F 1 ,T 1 )- z , (13) 

realized by the restriction of ip. 

An application of TheoremH] (Thorn's Isotopy Lemma) yields that (SP,jSP 
is (at (x, y)) locally isomorphic with Z' x (F 2 ,J r 2 ), where the codimension of 
Z' in M n+P coincides with the codimension of Z in JSP. 

For fixed z E Z the sets (SP, jSP^(A)) are hence pairwise isomor- 
phic for any choice of (/, g,h) E C and of (x, y) with jSP(f, g, h)(x, y) = z. 
The isomorphism may always be chosen compatible with A. Thus our proof 
is completed, if we find an SQP E C with jSP(SQP)(0,y') = z for certain 
y' E M p . 
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To this end we first construct a special quadratic problem SQP 1 . The 
problem size is (n, m,pi), where p\ := dim JSP — n. We sort the coefficients 
of y G MP 1 as follows: 

V = (Oj, «i, fy, /5j)(jj)=(l,l)...m 

and we define SQP X := V(f,g, h) with 
1 



:= 



z + a m ^ || 2 , gi(x, y) := a { x + a u hj(x, y) :~- 



bjx + f3j, 



where a, n ^ is the last entry in z. For y' := (a^, ccj, bj, ^j)(i t j)=(i,i),„ m , where 
cbi, cti etc., are the corresponding entries of z, we have jSP^O, y') = z, where 
jSP 1 := jSP^SQP^. We claim that the Jacobian DjSP^O,^') is regular 
and therefore SQP l belongs to C. In order to prove this, we sort the order of 
partial derivatives in the Jacobian oijSP 1 as ((ctaj, dai, dbj, 9/3j)(ij)=(i,i)... m , dx) 
and obtain the following Jacobian at (0, y') (where for each family of indices 
i and j only one representative is shown): 



D{D x9i ) 
D(D x h 3 ) 



D{ai 
D( gi 
D(bj 
D(hj 

D(D x f) = D(x + a, 



m< , 



/ Id 





V 



\ 



Id 




1 b 



Id j 



(14) 



Note that d ai (gi) and dbj(hj) vanish because x = 0; this fact has been under- 
lined by the entries zero under the main diagonal in (Tl4|) . It is clear that (TT4|) 
shows a regular upper triangular matrix, hence jSP l : M. n x IR Pl — > JSP is 
a local diffeomorphism in a neighborhood of (0, y'). 

This completes the proof in case p = pi . In case p > pi we use the problem 
SQP 2 , defined by setting SQP 2 (x, y) := SQP^x, y\ . . . y Pl ). It is clear that 
jSP(SQP 2 ) meets any submanifold of JSP (containing z) transversally, 
which completes the proof in case p > pi, too. 

It remains to cover the case p < p\. Let Z\ := jSPi 1 (Z). Note that 
(0,y') = jSP^ l (z). It suffices to find a dimensional affine subspace V of 
R Pl containing y' such that the product space (R n x V) meets Z\ transversally 
at (0,^'), meaning (formally) that the embedding of that product space into 
R™ x M P1 meets Z\ transversally. Indeed, since jSP 1 is a diffeomorphism, 
the latter transversality is equivalent with jSP l (W l x V)W\ Z at z. For local 
coordinates y in V and setting SQP 3 (y) := SQP^y), y G V, one therefore 
has jSP(SQP 3 )W\ X at z. 

For finding V we consider the canonical projection II : W 1 x W Pl — > MP 1 . 
It suffices to show that IJ(Zi) is a smooth manifold and II : Z\ — > H(Zi) is a 
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diffeomorphism, since then the existence of problem data (f,g,h) £ C with 
jSP(f, g, h)(R n+p ) implies that the codimension of Z in JSP does 

not exceed n + p, thus the codimension of IT(Zi) in R Pl is at most p, implying 
the existence of a jo-dimensional affine subspace V through y' meeting IT(Zi) 
transver sally at that point. 

It remains to show that II : Z\ — > H(Zi) is a (smooth) diffeomorphism. 
For later use we put this assertion in the following slightly more general 
lemma. 

Lemma 12 We consider a problem V(f,g,h) of size (n,m,p). Let be X C 
R™ x MP, (x,y) £ X, U an open neighborhood of (x,y), I C {1 . . .m<} and 
J C {1 . . . m = } such that the following conditions hold. 

(i) For any (x,y) £ X R U the point x is the unique stationary point of 
V(y) with (x, y) £ U . 

(ii) For any (x,y) £ X D U the pair (J*, J) belongs to I(x,y). (Recall that 
I* = I U {m<} and t/iat t/ie latter assumption implies I C Io(x,y).) 

(Hi) The Hessian Dl x Lj j(x, y, fi, A) is regular on the subspace ofW. n consist- 
ing of all vectors which are perpendicular to all D x gi(x, y) and D x hj(x, y), 
% £ /, j £ J, where fa, Xj are the unique multipliers with D x Ljj(x, y, /i, A) = 
0. 

Letting U : R™ x R p denote the canonical projection onto the second factor 
and Y := IT(X) ; there exist an open neighborhood U' of (x,y) and a smooth 
mapping x : V := H{U') —> U' such that it holds (x(y),y) £ X for any 
yeYDV. 

Proof. We consider the problem 

Vi s j(y) minimize f(x,y) s.t. g t < 0, % £ I, hj = 0, j £ J. 

From the assumption (J*, J) £ I(x,y) it follows that x is a stationary point 
also for Vi s j(y), whenever (x,y) £ X. Our assumptions guarantee that the 
point x is even a nondegenerate critical point for Vi t j(y) in the sense of [7]. 
This, according to [7], implies the existence of an open neighborhood U' C U 
of (x, and a smooth mapping x : V := n(J7') — > U' with the property, that 
for any y £ V the point x = x(y) is the unique stationary point of Vi t j(y) 
with (x, y) £ C/'. Since for (x, y) E X G U' the point x is the only stationary 
point of V(y) with (x, y) £ U' and x also is a stationary point of Vi t j(y), we 
necessarily have x = x(?/).This completes the proof of the lemma. □ 
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With X := Z\ and U := R n x R p , the assumptions of the lemma are 
satisfied. In fact, (ii) holds, since the combinatorial code is constant on X. 
Since SQP±(y) is always a quadratic problem with strictly convex objective 
function, condition (i) and (iii) are obviously guaranteed. Since Z\ is a 
smooth manifold, the assertion of the lemma shows that the restriction III^ : 
Z\ — > II(Zi) is a smooth diffeomorphism. □ 

In our proof we also have derived the following. 

Corollary 13 Any possible fiber XSPz, z of the characteristic set appears as 
a fiber of SP(SQP) a special quadratic problem SQP. 

4 Regular Transformations 

By means of the concept of a "regular transformation" we generalize and 
formalize what is known in optimization theory as the "introduction of slack 
variables" . 

Slack variables are frequently used to transform arbitrary finite systems 
of (linear) equalities and inequalities into a standard form, where inequalities 
merely appear in the form Xi > 0. This standard form supports for instance 
the (academic) implementation of the simplex method, c.f. e.g. [TJ. The 
"introduction of slack variables" roughly works as follows. Given a function 
/ : R n — >• R we are considering the set 



Using a slack variable x n+ \ G R we may define the functions f[(x,x n+ i) := 
x n+ i and /^(x, x n+ i) := x n +\ — f(x) and a transformed set 



It is easy to see that x G R™ belongs to the original set in (fl5i) if and only 
if the pair (x,x n+ i) := (x,f(x)) belongs to the transformed set in (fl6|) and 
that the transforming mapping x H- (x, x n+1 ) = (x, f(x)) is as smooth as /. 
Altogether, the introduction of slack variables turns sets given in der form 
(jl5[) into sets in the form (|16|) . 

Generalizing this we will turn stationary points of a given problem V(f, g, h) 
into points where MFCQ is violated by just replacing the objective function 
f(x, y) by a new constraint function g m *^(x, y, y p+1 ) := f(x, y) - y p+1 . More- 
over we will turn violation points of MFCQ of M(g) into stationary points 
with MFCQ by replacing the constraints gi(x, y) < by gi(x, y) — x n+ i < 
and adding an objective function f(x, x n+ i, y) := x n+ \ to be minimized. 



{x G W 1 | f(x) > 0}. 



(15) 



{(x,x n+1 ) G R n x R | f 2 {x,x n+1 ) = 0, f[(x,x n+1 ) > 0}. 



(16) 
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What is common in these transformations? In any case, a new variable 
has been introduced, smoothly depending on the original one. In the slack 
variable case we already described this mapping as x H- x n+ i := f(x). In the 
other two examples the corresponding mappings are (x, y) >->■ y p+ \ := f(x, y) 
and (x,y) i— > x n+ \ := 0, respectively. 

This gives rise to the concept of "regular" transformation, defined as fol- 
lows. The object of the transformation is (a family of implicitly defined 
sets) /~ 1 (F), where F C M. m is a fixed locally closed characteristic set 
admitting a Whitney regular stratification and where / : R n — > R m is a 
smooth defining function. Part of the transformation are a smooth embed- 
ding T tar : IR m M, where M C M m is a smooth submanifold, and a new 
characteristic set F' := T set (F) C 1R" 1 ', such that 

T tar (F) = F' DM. (17) 

The transformation also acts on the (variable) space M. n and involves T var := 
T mr (/) : W n W 1 ' such that the following conditions hold: 

/' o T var = T tar of (18) 

f'(R n ') CM (19) 

f~\M') c N\ (20) 

where M' := T' ar (M m ), iV' := T var (R n ). The transformation is called regular 
if for any Whitney regular stratification J 7 of F there exists a Whitney regular 
stratification J 7 ' of F' such that: 

T* ar (F, F) coincides with (F', F') D M (21) 

Mffi (F', F') in R m ' (22) 
/'(Ti M' in M. (23) 

Lemma 14 Compositions of regular transformations are regular transfor- 
mations. 

The proof of the lemma is easy and therefore omitted. 

Theorem 15 (On regular transformations) Let be given a locally closed 
Whitney regularly stratified set (F, F) C M. m and a smooth mapping f : M. n — > 
M. m with f(f\ (F, J 7 ) . Let T be a regular transformation as described above. 
Then the following assertions hold. 
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i) The diffeomorphism T var : IR n — y N' is a stratified isomorphism be- 
tween f~ 1 (F,J r ) and f'~ 1 {F\J z '). Equation shows a commutative 
diagram of stratified mappings. 

f-\F,7) A (F, J 7 ) 

| T var | T tar (24) 

f-\F',P) A (F',F) 

ii) For T tar (z) = z', Z G 7 and Z' G 7' with z G Z and z' G Z', the 
mapping T tar is a stratified isomorphism between appropriate represen- 
tatives of (F, T^z^z an d (F' , J 7 ') z> ,z> ■ 

Proof. ad(i) First we prove that T var maps f~ 1 (F) surjectively (thus bijec- 
tively) onto f 1 ' 1 ^ 1 ). Since T tar : M m — y M' is a diffeomorphism and since 

M' D T tar (F) ^F'nMwe also have T tar (F) = F' fl M' and therefore: 

x G r l (F) f(x) eF^f'o T mr (x) ® T tar o f( x ) G F' n M'. (25) 

Hence x G f~ x (F) implies T var (x) G f'~ 1 (F'). On the other hand let x' G 
Using (JTSD this implies J(x') G F' n Af = F' n M'. By ([20]) this 
yields x' G N', thus x' = T 1 *""^) for some x G K n . Applying (1251) we conclude 
x G f~ 1 (F). Altogether, T uar : -> f'~ 1 (F') is surjective. 

The smooth embedding T* ar is a stratified mapping due to (1211) . The 
mappings / and /' are stratified mapping by definition. Moreover, for any 
Z G T the mapping T var maps the stratum / _1 (Z) to the stratum f'~ 1 (Z'), 
where Z' G J 7 ' is the stratum containing T tar (Z), which exists due to (I2ip . 
Hence, by ffTS]) . also T mr is a stratified mapping, even a stratified isomor- 
phism, since it is smooth and maps f~ 1 (F) bijectively onto f'~ l (F'). 

ad (ii) For ease of notation we identify one point sets with its point. 

T tar (Z) is a submanifold ofM'cMc R rn ' . Since we have Z'nM? 

Z' n M' = T tar (Z) and Miu Z' we can choose local coordinates such that 
z ' = 0, T' ar (Z) = R dl x 0, M' = M dl xl*xO,M = R dl x x R <fe x , 
R m ' = x R d * x x R di and Z' = M dl x x x R d4 . Let : R m ' -> R d > 
denote the canonical projection onto the z'th factor. For generating the fibers 
to be compared, we can choose the local projections ty : R m —y Z such that 

T tar onoT tar \~}, = ni (26) 

and it' : R m ' -> Z' as it' := (^,0,0,^). Then we have T tar (it' 1 (z)) = 
x R d2 x x and ir'- l (z') =0xi*x R d[i x 0. By (H7J) it holds F'nlc M', 
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thus -n'- l (z') n F = (0 x R d ' 2 x x 0) D F' . Due to ((HD and (J2SJ) we also 
have ^(tt -1 ^) n F) = (11^,(0) x x 0) n F' = (0 x R d * x x 0) n F' . 
Altogether we see that T tar maps (F, F) n 7r _:L (x) onto (F\F') n Tr'" 1 ^'), 
proving the assertion. □ 
In the following we treat transformations that we call "elementary" . We 
do not specify all things explicitly, since some of them are given by the 
concept of a transformation itself, for instance M' C M. m is already given if 
rptar j g QigfingcL jf no t defined differently (Type 2), M coincides with M m . 
We always consider the situation of an implicitly defined (family) / _1 (F) 
with fixed characteristic set F in the target space of /. 

Definition 16 (Elementary Transformation of Type 1) Type 1 trans- 
formations introduce a new variable. They are induced by a smooth function 
g : W 1 -> W as follows. We define T var (x) := (x,g(x)) G W 1 ' , n' := n + p. 
In the target space this corresponds T tar (z) := (z,0) G M m ; m! '■— m + p. 
In order to have [T7\ ) we need to define F' := T tar (F) = F x 0. and for 
^2JD let J=' := T tar (J") := {T tar (Z) | Z G J 7 } for given stratification J= of F . 
For the definition of f we distinguish two subtypes. In subcase la the latter 
function is defined by setting f'(x,y) := (f(x), ±(/(x) — y)) and in subcase 
lb byf(x,y) := (y, ±(f(x) - y)). ' 

Definition 17 (Elementary Transformation of Type 2) Type 2 trans- 
formations just expand the target space by some additional dimensions. They 
are defined by setting m' :— m + q and for given Q el' by T tar (z) := (z, Q). 
We put M — M' :— M m x Q, F' := Fx W and for given stratification T of F 
we put F' := J 7 x M. q . Finally we define T var (x) := id^n and f'{x) := (x, Q). 

Definition 18 (Elementary Transformation of Type 3) Type 3 trans- 
formations deform the target space by means of a diffeomorphism. In order 
to define them let U C M m be an open set such that U D F D f{R n ) and Lp : 
U ->■ V C R m be a diffeomorphism. Then we define M := M' := W 1 ' := W m , 
T tar := ip, (F', F') := cp(F,F) and f := <p o f. Letting T var := id Rn we are 
done. 

Lemma 19 All types of elementary transformations are regular. 

The proof of the lemma is straightforward and therefore omitted. 

Now we show that the introduction of slack variables and the transfor- 
mations between stationary point sets and violation sets of MFCQ can be 
written as (compositions of) elementary transformations and that they are 
therefore regular. 
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The transformation SLACK, introducing a slack variable, deals with 
f'\F), where / : R n -»■ R and F := [0,oo). We define SLACK var (x) : = 
(x,f(x)), SLACK tar (z) := (z,0) G M := M m ', m' := 2. Setting F' : = 
SLACK tar (F) = [0,oo) xO and /'(x,y) := (y,y-f(x)) we see that SLACK 
is of type lb. 

The transformation SP2MF, transforming SP(n, m, p) C M n+P into MF(n, m*,p+ 
1), can be written as a type la transformation as follows. For problem 
data (/, g, h) of V(n,m,p) the defining mapping for SP and SP is jSP : = 
jSP(f,g,h). Then the setting to be transformed is jSP~ 1 (XSP), where 
XSP := XSP(n,m). The transformation SP2MF is defined to be the type 
la transformation induced by the mapping g m * = / : R n+P — > R. The tar- 
get space of the mapping SP2MF tar : JSP = JSP(n, m) -»■ JSP x K, 
a5P h> (crSP,0), may be considered as JMF = JMF(n,m*). By the 
very construction it holds (I ,T)(a SP, 0) = (Iq,1)((t SP), where J* : = 
J U {m*}. Thus the transformation acts uniquely on the combinatorial code, 
written as SP2MF code ((I ,l)) := (J *,X). Moreover SP2MF tar (XSP) pre- 
cisely coincides with XMF {m * <} = {a MF e XMF | m*< E I (aMF)} and 

SP2MF func {jSP{f,g,h)) = jMF(G, H). Therefore SP2MF var (SP) = 
MF {r<} = 3 MF-\XMF {m * <} ). 

The transformation MF2SP models violation sets of MFCQ in terms of 
stationary point sets, provided that no equality constraints are present. In 
the latter case we identify m = m<. For problem data g for M(n, m,p) (with 
m = = 0) we define new problem data (F,G) for V(n + l,m,p), acting on 
variables (x, x n+1 , y) G lR n x R x W, by setting 

F:=x n+1 , Gi := gi{x,y) - x n+1 , i = l...m. (27) 

MF2SP is the composition of three elementary transformations. Its vari- 
able space action is MF2SP var : R n x R p -> M n+1 x R p defined by set- 
ting MF2SP var (x,y) := (x,0,y). Letting SP := SP(F,G) and SP := 
SP H P _1 (0), we obviously have (x,y) G MP := MF(g) if and only if 
(a;, 0,y) G SPo. (In contrast to SP2MF the newly introduced variable does 
not contribute to the parameter space but to the state space.) In order 
to express MF2SP as a composition of elementary transformations we use 
transformations of types la, 2 and 3. For convenience (in a later application) 
we start with transformation of type 2 followed by T3 of type 3 which are 
known to only act on the target space and to leave the variable (x, y) G R n+P 
unchanged. 

We define T\ ar : JMF := JMF(n,m) -> JSP := JSP(n + l,m) by 
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setting 



i=l...m 



Reordering variables we identify JSP = JMF x ~R q , q := m + n + 1 , a SP = 
(aMF,Q), where 

Q := (Kn+i) i= i..,n*,a m *) := ((-l) i= i... m ., 0) G M n+1 x R n = R". (29) 

By construction it holds T( unc (jMF)(x, y) = T t 2 ar ojMF(x, y) = jSP(x ± Q, y), 
where jSP : = jSP{F,G). Recall that we have M' 2 = M 2 = JMF x Q. By 
inspection we see that T 2 acts as follows on the combinatorial code: T 2 ode : 
(J , 2) i — ^ (J , X*), where X* := {J U {m*} | J G X}. Since T 2 * ar : JMF -> M^ 
is a global diffeomorphism, this proves T 2 ar (XMF) = XSP D M 2 . Moreover 
we see that T 2 tar (XMF) n XMF(n + l,n) = 0. Since T 2 is a regular trans- 
formation we automatically have Mrfi (T 2 ar (XMF, A) x M 9 ) for any Whit- 
ney regular stratification ^4 of XMF, but we cannot automatically conclude 
Mrfi (XSP, A') for some Whitney regular stratification .A' of XSP. 

The latter (technical) problem is solved by means of the transformation 
J3, which deforms JSP locally but leaves XSP(lM 2 unchanged. Let us write 
a point Q e W = K m+1 x M n as Q = ((a i>n+ i) i=1 ... m *,a m *). We define the 
open subset U := {Q G M. q \ a^ n+ i < 0, i = 1 . . .m, a m * jn+ i > 0} C K c/ 
which obviously contains Q- Let ip : JMF x [7 — > JSP be defined by setting 

ip(aMF, Q) := 

L ■ (30) 



11 — y 

\ \ x / / i=l. ..m \ ' - 

One easily checks that (p(.,Q) = T 2 tar and that <£> is a smooth diffeomorphism 
onto its image ip(JMFxU) =: V\ By construction it holds (Jo,X) (ip(a MF, Q)) 
T™ de ((J ,X)((tMF)). Hence we have ip{XMF x U) = XSPDV. Identifying 
JSP = JMF x IR 9 , we may consider JMF x U as an open subset of JSP, 
thus i^asa diffeomorphism, defined on an open set containing M2, such that 
(p\ M2 = id M2 - 

Let T 3 be the type 3 transformation induced by ip. Since T[ unc = id and 
T™ de = id it holds (T 3 o T 2 ) func = T( unc and (T 3 o T 2 ) code = T™ de . 

In order to describe T\, necessary to understand MF2SP as a composi- 
tion T\ o T3 o T2 of elementary transformations, we do not write SP in our 
standard form SP = jSP~ 1 (XSP). Instead we use a (slightly less reduced) 
jet extension of (F, G), namely jSP := (jSP (F,G)) := (JSP(F,G),F) : 
R «+i xR p^ jsp ■= JSP x E. Since MF2SP var (x,y) = (x,0,y) is al- 
ready given, we have Tf ar (x,y) = (x,0,y), thus our type la transformation 
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is induced by the mapping K" x R p -> I, (x, y) (->• 0. Using the "+" version 
of T( unc we conclude that MF2SP func (jMF(g)) = jSP (F,G). Moreover 
we have MF2SP tar (XMF) = T{ ar (XSP n V) = XSP n(Vxl), 

Theorem 20 (i) The transformations SP2MF and MF2SP (the latter 
only defined for m= = 0) are regular. The transformations are well- 
defined for arbitrary (smooth) problem data. The mappings SP2MF var 
and MF2SP var are smooth embeddings, mapping SP(n,m,p)(f, g, h) 
onto MF(n,m*,p + 1)(G, #){mj.} an d MF(n,m,p)(g) onto SP(n + 
l,m,p)(F,G)o, respectively. 

(ii) For any problem size (n, m,p) with m = = 0, any Whitney regular strat- 
ification A of XMF '(n, m), any choice of problem data g for M(n, m,p) 
with jMF(g)Jf\ A and any (x, y) G MF(g) the following holds. There 
exist problem data (f',g') forV(n + l,m,p — l) andy' G MP~ l such that 
jSP(f , g')Jf\ A' for certain Whitney regular stratification ofXSP{n + 
l,m) and there exists a local stratified isomorphism between MF(g)^,y) 
and SP(f\g') { ^ yl) . 

Proof. Assertion (i) is clear from construction. In order to verify (ii), put 
z := jMF(g)(x, y) and let Z G A be the stratum containing z. Let d denote 
the codimension of Z in JMF. Then the dimension of jMF~ l (Z) is n+p—d. 

Let z' := (T3 o T2) tar (z) and Z' G A 1 be the stratum of the corresponding 
stratification A' of XSP(n+l, m) that contains z' . Note that the codimension 
of Z' in JSP(n + 1, m) is also d. As in the proof of Theorem [T] we construct 
the problem SQP 1: such that jSP-Jfi A' and such the z' = j5'P 1 (0,?/ / ) for 
certain y' G MP, p := dim JSP — (n+ 1). In analogy to the proof of Theorem 
[U for p' large enough, we can construct a p'- dimensional affine subspace 
of MP containing y' such that the restriction of SQP l to V also meets A' 
transversally. In order to obtain the same local structure as in SP(n,m,p) 
we only need to guarantee that the dimension of jSP^y 1 ^') = (n+l)+p' — d 
also is n + p — d, being satisfied if p' = p — 1 . □ 



5 Proof of Theorem 2 



In the Introduction we have already seen that for problem data from C the 
set SP \ MF is a topological manifold of dimension p. Since SP \ MF = 
SP \ MF, it therefore suffices to locally prove the assertion at the points 
from MF C ~SP. 

In view of Thorn's Isotopy Lemma (Theorem H]) and Lemma fTUl it suffices 
to prove for any Whitney regular stratification A of XSP respecting the 
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combinatorial code, any stratum Z G A with Z C MF and any point z £ Z, 
that the fiber XSPz, z constitutes a topological manifold with boundary and 
that the boundary exactly is XMF z )Z - 

The key of the proof consist of performing the transformation T = X3 o 
T2 o SP2MF and to investigate, applying Theorem [T5l (ii), onto which part 
of a fiber the target space action T tar transforms the fiber XMFz )Z - In 
this investigation our information on T code is very helpful. In fact we have 
T code = T code Q T code Q sP2MF code . S P2M F code adds m* to I and leaves X 
unchanged. In the next step, T 2 cocfe leaves Iq unchanged and adds (to*)* to any 
member of X, and finally T£ ode does not change anything. After renumbering 
(decreasing to by 1) it therefore suffices to prove the following lemma. 

Lemma 21 For any problem size (n, to) with m= = 0, any Whitney regular 
stratification A ofXSP = XSP(n,m) respecting the combinatorial code, any 
stratum Z G A with Z R XMF = and Z C XSP^ m y, and any point z G Z, 
the part of the fiber (XSP, A)z,z belonging to XSP{ m } is a topological manifold 
with boundary and the latter boundary is exactly the part of the fiber belonging 

t0XSP\ m y ' 

Here z belongs to XSP{ m y if and only if to € Io{z) and to XSP*s m \ if and 
only if to G Iq{z) and there exists / G X(z) with m(jLI. 

Note that the assumption to = = has merely been made to make it 
easier to see, that it exactly deals with the result of T tar . The assertion of 
the lemma itself does not require this assumption. 

Proof. As before we write elements of JSP = JSP(n,m) as z = (y,a m *) = 
((ai,ai) i=1 ... m ,a m *) and in particular z = (y,a m *) = ((a i} ai)i=i... m , a m «). 

As in the proof of Theorem [1] we use SQP = SQP(n,m,p) with p : = 
dim JSP — n, whose problem data /,$:M n xR ! '->l are defined by setting 

f(x,y) := -\\x - a m *\\l, gi(x,y) := x 1 a, + a u i = 1 . . . to. (31) 

Letting jSP := jSP(SQP) we have jSP(0,y) = z and there exist open 
neighborhoods U of (0, y) and V of z such that jSP : U — > V is a diffeomor- 
phism. Put Z := jSP~ x {Z), SP := jSP~ l (XSP), SP {m} := jSP~ l (XSP {m} ) 
and 5P{ m } := j S 'P -1 (XS 'P\ m x) ■ Since jSP respects the combinatorial code 
it suffices to show the existence of a projection mapping n : MJ 1 x R p — > Z, 
defined on a neighborhood of (0, y) G Z, such that the fiber SP{ m } ri7r~ 1 (0, y) 
constitutes a topological manifold with boundary SP^ m y fl 7r~ 1 (0,|/). Note 
that for (x,y) e K" x i p we have (x,y) G SP{ m y if and only if to G I (x,y) 
and for (x, y) G SP{ m } we have (x, y) G 'S'P/jj,,} if and only if there exists 
/ G X(x, y) with to ^ X 



21 



First we prove that SP{ m } is a manifold with boundary SP*^ m y Since 
there exists a feasible point (namely 0) for SQP(y) and MFCQ holds at this 
point, the constraint set M(y) of SQP(y) is nonempty for any y G U, where 
U C W is a sufficiently small open neighborhood of y. Hence any problem 
SQP(y), y £ U, is solvable and its minimizer is the unique stationary 
point of SQP(y). It is well-known, that the mapping y i— > x(y) is continuous, 
thus tp : U — > R n x R p , := (x(y),y), is a topological manifold chart of 
SP. 

Writing elements y of R p as ((a*, ai)i=i... m ), we also use the notation y' := 
((aj, Q!i)i = i.„ m _i, a m ), i.e. we have y = (y',a m ). We claim the existence of an 
open neighborhood V C R n_1 of y' and a continuous mapping a m : V — >■ R 
such that its graph graph(a m ) := {(?/', a m (y')) | y' G parametrizes (via 

SP{m} an ^ ^ s epigraph {(y', a m ) G V x R | a m > a m (y')} parametrizes 
SP {m} . 

For proving this claim, we consider the special quadratic problem SQP'(y') : = 
V(f,gi . . . g m -\) of size (n, m — l,p), where /, gi are exactly the functions 
defined in (T5TT) . Note that SQP'{y') is obtained from SQP(y) by just delet- 
ing the constraint g m < 0, thus its constraint set contains the constraint set 
of SQP(y). Hence, if the neighborhood V C R p_1 of y' is chosen sufficiently 
small, the constraint set of SQP'(y') is also nonempty for any y G V and as 
above for SQP there exists a continuous mapping x' : V — > R n such that 
x'(y') is the unique stationary point of SQP'(y'), y G V. Now we are able 
to define a m : V — > R by setting a m (y') := — x'(y') T a m . Without loss of 
generality we may assume graph(a m ) C U. We have to verify the predicted 
properties of the mapping a m . 

In fact, since SQP'(y') is just SQP(y) with the constraint g m < deleted, 
x'(y') is also a stationary point for SQP(y), provided that it is feasible for 
that problem, i.e. for any a m < a m (y'). In case a m = a m (y'), the constraint 
9m < is active at (x, y) := (x'(y'), y', a m ). Since x'{y') also is a stationary 
point of SQP'{y') there exists / G I(SQP)(y) with m G" /, i.e. this point 
(x,y) belongs to iSPr m i. In case a m < a m (y'), the constraint g m < is 
not active at (x, y) := (x'(y'), y', a m ), i.e. it does not belong to SP{ m }. 
In case a m > a m (y'), the point x'{y') is not feasible for SQP(y), where 
y = (y',a m ), since the constraint g m < is violated. Hence the stationary 
point x(y) of SQP(y) must differ from x'(y'). This implies that the constraint 
9m < must be active at (x(y),y), since otherwise x(y) would necessarily be 
a stationary point of SQP' (y'), thus it would be x'{y'). Altogether we have 
seen that <p : U — > R n x U parametrizes SP{ m } for a > a m (y') and SP r m i 
for a = a m (y'), thus S'Pjm} is a manifold with boundary SP*^ m y 

For obtaining the corresponding assertion for the fibers, it suffices to 
prove the existence of a local projection mapping n : R n x R p — y Z such 
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that 7r 1 (0,y) = M n x N x R for a suitable (smooth) submanifold iV C 
M p_1 containing y'. In fact, then SP D tt - 1 (0, y) is parametrized (via ip) by 
{(y',a m ) | y' G N, a m > a m (y')}, etc. 

For any (x,y) G M n x R p we can tell the combinatorial code (Jg,X') 
of (x, y') w.r.t. SQP'(y') from the combinatorial code (Iq,T) of (x, y) w.r.t. 
SQP(y). Indeed, we have I' = Iq\ {m} and X' is obtained from X by deleting 
all I G X containing m. Letting IT' : M" xMMl"x W~\ U : R n x R p ~ x -> 
denoting the canonical projections H'(x, y) := (x, y'), n(x, y') := y', and 
defining X := U'(Z), it is therefore clear, that the combinatorial code w.r.t. 
SQP' is constant on X C SP(SQP'). Hence we can apply Lemma [12] to 
SQP', (x, y') G SP(SQP'), the projection mapping II : X -> Y := U(X) and 
U := IR n x V, where V C IR n_1 is an open neighborhood of y'. Provided that 
the neighborhood V C V of y' has been chosen small enough, the assertion 
of Lemma [12] implies the existence of a smooth mapping x" : — > R n such 
that x = x"(y') is the stationary point of SQP\y'), i.e. x"(y') = x'(y'), for 
any y' G fl Y". This gives rise to a smooth mapping ip" : 1/ — > IR n x V, 
^"(y') := (x"(y'),y')- Note that </|y = n| x \ 

Moreover, for any (x, y') G X, the value of a m G M with y m (x, y', a m ) = 
is unique. Since y m < is active on Z, we therefore have ILI^ 1 = (p'\x, where 
ip'(x,y') := (x,y', -x T a m ). 

Since tp' : R n x W^ 1 — )■ IR n x IF is smooth, the mapping ip 1 o <p : V — > 
M n x IR P is smooth and we have o </?| Y = (II o n')|^ . Hence Y fl V is a 
smooth submanifold of IR P_1 . 

Now let 7Ty : M p_1 — > Y be an arbitrary smooth projection mapping, 
defined on an open neighborhood (contained in V) of y' and put tt := ip' o ip o 
7Ty o n o n'. Then we have 7r(x, y) = (0, y) if and only if 7Ty o n o n'(x, y) = y', 
thus 7f _1 (0,y) = R n x TTy^y') x R. Putting X := Tr^y'), we are done. □ 

6 Final Remarks 

The following example shows that the assumption m = = of Theorem [2] 
cannot be omitted. 

Example 22 For the problem size (n,m), given by n := 2, m< := 0, m= = 
1, we consider 

XSP= {((k, /3i),a *) G (R 2 x E) x M 2 | = 0, det(&i|a ») = 0}. 

TTie /atter sei, a cone over a torus, fails to have the local structure of a 
topological manifold with boundary at the vertex of the cone, the point z : = 
((0,0), 0). Now we consider our standard special quadratic problem SQP : = 
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SQP l from the proof of Theorem^ such that jSP(SQP)(0,y) = z. Then 
jSP(SQP)Wi {z} and, since jSP(SQP) is a local diffeomorphism, SP has 
the same local topological structure as XSP. 

For having this example in explicit terms, let p := 3 and put 

f(x, y) := x\ + x 2 2 , hx(x, y) := x x y Y + x 2 y 2 + 2/3, V ■= (0, 0, 0). 

Remark 23 (Smoothness is not required) The assertions of this article 
remain true if the assumption of smoothness of the problem date is weakened 
to C 2 . 
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